DICE API Documentation/com.embabel.dice.pipeline

Package-level declarations

Types

class BatchedExtractionStrategy : ExtractionExecutionStrategy, AutoCloseable

Processes chunks in fixed-size windows: each window fans out concurrently on the injected executor and is fully joined before the next window starts. This is the rate-limit lever — it caps in-flight extract() calls to batchSize at a time. Results are returned in input order.

ChunkPropositionResult

sealed interface ChunkPropositionResult : PersistablePropositions

The outcome of processing a single chunk through the proposition pipeline.

ExtractionExecutionStrategy

interface ExtractionExecutionStrategy

Controls how the PropositionPipeline dispatches the stateless per-chunk extraction stage. Implementations choose serial or concurrent execution; the resolution stage (entity resolution) always runs serially regardless of the strategy, preserving cross-chunk entity identity.

ParallelExtractionStrategy

class ParallelExtractionStrategy : ExtractionExecutionStrategy, AutoCloseable

Fans all chunks out concurrently on the executor via CompletableFuture, then joins them in input order. A failed extraction yields a null slot.

PersistablePropositions

interface PersistablePropositions : EntityExtractionResult, PropositionExtractionResult

Result of entity and proposition extraction that can be persisted. Combines com.embabel.dice.common.EntityExtractionResult and PropositionExtractionResult. Guides callers to know what to persist, within their own transaction scope.

PropositionExtractionResult

interface PropositionExtractionResult

Common interface for proposition revision statistics.

PropositionExtractionStats

data class PropositionExtractionStats(val newCount: Int, val mergedCount: Int, val reinforcedCount: Int, val contradictedCount: Int, val generalizedCount: Int)

Statistics about proposition revision outcomes.

PropositionPipeline

class PropositionPipeline

Pipeline for extracting propositions from chunks. Coordinates extraction and entity resolution.

PropositionResults

data class PropositionResults(val chunkResults: List<ChunkPropositionResult>, val allPropositions: List<Proposition>) : PersistablePropositions

Result of processing multiple chunks through the proposition pipeline. Implements EntityExtractionResult for access to entities needing persistence.

SerialExtractionStrategy

object SerialExtractionStrategy : ExtractionExecutionStrategy

Default strategy: processes each chunk one at a time on the calling thread. A failed extraction produces a null slot rather than propagating the exception.